Simultaneous Estimation of Texture Map and Pseudo Illumination from Multiple Views
نویسندگان
چکیده
We consider the problem of simultaneously estimating surface texture map and the pseudo illumination, which is the combined effect of illumination and surface BRDF, given the object geometry and its calibrated images taken from multiple viewpoints. We derive the bilinear reflection equation that relates the texture albedos and the pseudo illumination to the surface reflectance. The reflection equation takes into account the diffuse/specular reflection, and casting shadows. The ambiguities in estimations are resolved by grouping surface points of the same albedo into a single cluster and performing the estimation for the cluster jointly. A modified mean shift color clustering algorithm is used for this purpose. We estimate the pseudo illumination, the diffuse and specular albedos of each cluster by solving iteratively a system of bilinear equations. Experimental results on synthetic and real objects are provided.
منابع مشابه
Colour Texture Fusion of Multiple Range Images
Texture mapping of manifolds that were reconstructed from different range views requires the fusion of the texture maps acquired from different views. Illumination conditions and camera technology prevents colour continuity in the fusion process leading to observable discontinuities in the colour (and also lightness). This paper presents a simple method for the correction of this discontinuity....
متن کاملNew Pseudo-CT Generation Approach from Magnetic Resonance Imaging using a Local Texture Descriptor
Background: One of the challenges of PET/MRI combined systems is to derive an attenuation map to correct the PET image. For that, the pseudo-CT image could be used to correct the attenuation. Until now, most existing scientific researches construct this pseudo-CT image using the registration techniques. However, these techniques suffer from the local minima of the non-rigid deformation energy f...
متن کاملStochastic Refinement of the Visual Hull to Satisfy Photometric and Silhouette Consistency Constraints
An iterative method for reconstructing a 3D polygonal mesh and color texture map from multiple views of an object is presented. In each iteration, the method first estimates a texture map given the current shape estimate. The texture map and its associated residual error image are obtained via maximum a posteriori estimation and reprojection of the multiple views into texture space. Next, the s...
متن کاملMultiple-cue Illumination Estimation in Textured Scenes
In this paper, we present a method that integrates cues from shading, shadow and specular reflections for estimating directional illumination in a textured scene. Texture poses a problem for lighting estimation, since texture edges can be mistaken for changes in illumination condition, and unknown variations in albedo make reflectance model fitting inpractical. Unlike previous works which all a...
متن کاملCoherent Texture Synthesis for Photograph Relighting and Texture Replacement
In this thesis, we present a texture synthesis method for realistic rendering without acquiring the actual reflectance properties. The method is from the observation that most objects have texture repeatedly laid on different locations of their surface explicitly or implicitly. These samples form a pretty sparse set of BTFs. Our goal is to extract the underlying texture from photographs of the ...
متن کامل